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LIMITING SPECTRAL DISTRIBUTIONS 
OF SUMS OF PRODUCTS 
OF NON-HERMITIAN RANDOM MATRICES 


H. ROSTERS * 1 ’ 3 AND A. TIKHOMIROV 2 ’ 3 

Abstract. For fixed l,m > 1, let X^ 0 - 1 , X) 1 * ,..., X.IP be independent random 
n x n matrices with independent entries, let F^ := Xjf^Xl, 1 *)^ 1 • • • (X^) -1 , 
and let F^,..., fJ,™ 1 be independent random matrices of the same form as 
F^. We investigate the limiting spectral distributions of the matrices F^ 0 - 1 and 
F^ + .. . + Fi™' ) as n — > oo. Our main result shows that the sum F^ + .. .-t-F^ 
has the same limiting eigenvalue distribution as f£°' ) after appropriate rescaling. 
This extends recent findings by Tikhomirov and Timushev (2014). Furthermore, 
we show that the limiting eigenvalue distribution of the matrices F^ is stable 
with respect to a suitably defined convolution ©. 

To obtain our results, we apply the general framework recently introduced 
in Gotze, Rosters and Tikhomirov (2014) to sums of products of independent 
random matrices and their inverses. We establish the universality of the limiting 
singular value and eigenvalue distributions, and we provide a closer description 
of the limiting distributions in terms of free probability theory. 


1. Introduction and Summary 


The investigation of the asymptotic spectral distributions of random matrices 
with independent entries is a major topic in random matrix theory. In recent years 
sums and products of independent non-Hermitian random matrices with indepen¬ 
dent entries have found increasing attention; see e.g. 

20j [2T 


19 

[4, 15 


23, 30, 31 32, 34, 35, 37 39, 43, 44, 45 


and also the survey papers 
and the references therein. In particular, the paper 1211 provides a general 


approach for the investigation of the limiting (global) spectral distributions of 
products of independent random matrices with independent entries. Furthermore, 
the paper [45] shows that this approach proves useful for the investigation of sums 
of products of independent random matrices as well. The main aim of the present 
paper is to show that certain products of independent random matrices give rise 
to random matrices with stable limiting eigenvalue distributions, in the sense that 
the sums of several independent copies of these products have the same limiting 
eigenvalue distribution after appropriate rescaling. 
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Throughout this paper, for each n > 1, let X^^Xn^X®,... be independent 
random matrices of size nxn with independent entries. More precisely, we assume 
that 


x »’ = . 


p'n jk 


( 1 . 1 ) 


where (X^)j t k, q e N is a family of independent real or complex random variables 
such that 


EX^ = 0, E(X^) 2 = 1 in the real case 


jk 


( 1 . 2 ) 


and 




d ?)\2 


d ?)|2 


EXj^ = 0, E {xy^y = 0, E|X)^| Z = 1 in the complex case, (1.3) 

and we additionally assume that this family is uniformly square-integrable, i.e. 


lim sup EfljrJfl 2 1 


3 j,fc,qSN 


i k 1 J ‘{|xj«|>o} 

-( 9 ) 


i)= 0 ' 


(1.4) 


In this case we also say the matrices X„ are independent Girko-Ginibre matrices. 
In the special case where the entries have real or complex Gaussian distributions, 


we usually write '^Yjk)jk=i,...,n instead of = (^=X { $)j k = and 


call the matrices y!, 9 * Gaussian random matrices or Ginibre matrices. Note that 


-(<?) 
1 jk 


(9) 


dl)\ 

y jk 


the assumption (1.4) is clearly satisfied in this special case, the random variables 
Yjj" being i.i.d. 

We are interested in the spectral distributions of sums of products of the matrices 


X 


^ and their inverses, such as xi^X^+X^X^ or X<“(X 


Ph-t+xWfxl 41 '- 1 


in the limit as n —> 00 . More precisely, we consider matrices of the form 


F„ := Fn i) -VJI 

9=1 


q =1 r =1 


(1.5) 


where m 6 N, I £ ft, and Z\ E {+1, — 1} are fixed. (Thus, the matrices 

are independent random matrices of the same form as the matrix nUwT-) 
Let us note that under the above assumptions 0 ( |1.4| ), for f ixed r E N, 

xi r) is invertible with probability 1 + o(l) as n — > 00 (see e.g. Lemma |6.5| ), so that 
F n is well-defined with probability 1 + o(l) as n —> 00 . Since we are interested in 
limit theorems in probability, this is sufficient for our purposes. 

Furthermore, write Ai,..., X n for the eigenvalues of F n and p n := l n 
for the (empirical) eigenvalue distribution of F n . Note that p n will in general be a 
probability measure on the complex plane, F n being non-Hermitian. We are inter¬ 
ested in the problem(s) whether there exists a non-random probability measure p 
on the complex plane such that p n —> p weakly (in probability, say) and whether 
this probability measure p can be described more explicitly (in terms of its density 
or one of its transforms, say). If existent, the probability measure p is also called 
the limiting eigenvalue distribution of the matrices F n . 

As is well known in random matrix theory, the limiting eigenvalue distribution 
p is usually universal, i.e. it does not depend on the distributions of the matrix 


entries apart from a few moment conditions as in (1.2) - (1.4). In our situation, 
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we have the following universality result: 


Proposition 1.1. Let the matrices F r: 


be defined as in (1.5). Then there exists 
p weakly in prob- 


a non-random probability measure p on C such that p n 
ability, and the limiting eigenvalue distribution p is same as in the Gaussian case, 
i.e. for the corresponding matrices F„ derived from Gaussian random matrices 

v(2) 'y-(S) 
x n ? x n 


For a closer description of the limiting eigenvalue distribution p, see Theorem 5.4 
below. For the moment, we confine ourselves to a few comments. 

First of all, by universality, it remains to find the limiting eigenvalue distribution 

(V) 

p in the Gaussian case. Now, the Gaussian random matrices Y^ ; are bi-unitary 
invariant, i.e. for any unitary matrices Un' and of size n x n, the matrices 
U^Y^V,^ have the same (matrix-valued) distributions as the matrices Y 
This clearly implies that the limiting eigenvalue distribution p of the matrices F n , 
if existent, will be a rotation-invariant probability measure on the complex plane, 
i.e. for any u £ T := {z £ C : \z\ = 1}, the induced probability measure of p under 
the mapping z >—>■ uz will coincide with p. Hence, if p has a density / (which will be 
the case in all our examples), this density may be supposed to be rotation-invariant 
as well, and we write f(r) instead of f(z), with r := \z\. 

Let us mention some relevant results from the literature. 


Examples 1.2. 

(a) ( Circular Law) Let F n = X^. Then f(r) := \ l[o,il( r ), he. h is the uniform 
distribution on the unit disk. 


(b) Let F n = X&° + 


. + x|, m ^. Then F„ is a random matrix with independent 
entries of mean 0 and variance m/n , so, by simple rescaling, f(r) := lr 0 iV / ^](?’). 
In particular, for the rescaled matrices ^^F n , the limiting eigenvalue distribution 
is again the uniform distribution on the unit disk. 

(c) Let F n = Xn^xi 2 ^. Then /(r) = 2^1[o,i]( r )) i- e - I 1 is the induced dis¬ 
tribution of the uniform distribution on the unit disk under the mapping z >—y z 2 . 


See e.g. 21, Section 8.2.2] for a ‘simple’ derivation. 

(d^Let F„ = X« 1 >X<?>+.. .+X< 2 ’"- 1 >xi 2 ’">. Then /(r) = , V(m _ 1 1|>+4 , J l^M 
see |45, Section 2], 

(e) ( Spherical Law) Let F n = X^(X^) -1 . Then f(r) = 


i.e. 


p is the spherical distribution on the complex plane (which is, by definition, 
the induced distribution of the uniform distribution on the 2-dimensional sphere 
S 2 := {x £ M 3 : ||x|| = 1} under stereographic projection to the complex plane 
C ~ M 2 ). 

_ 


(f) Let F n = X^^X®)- 1 + ... + xi 2m - 1) (X, ( , 2m) )- 1 . Then f(r) = 


see 


45 


m . 

7r(m 2 +r 2 ) 2 ’ 

Section 3]. Thus, for the rescaled matrices ^~F n , the limiting eigenvalue 
distribution is again the spherical distribution on the complex plane. 

In view of examples (b) and (f), it seems natural to ask whether there exist 
further examples of random matrices F^ such that for any m £ N, the sums of 
m independent matrices of the same form as F^ have the same limiting eigen¬ 
value distribution as the original random matrices F^, after appropriate rescaling. 
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We will answer this question in the affirmative by proving the following result, 
which contains examples (b) and (f) as special cases: 


Theorem 1.3. Fix m E N and l E No, let 


( 1 . 6 ) 


where X®, X^ 1 *, 


• v -(0 

• • • , 


are independent random matrices as in (1.1) - rtl.4 


and let F^,..., Fj” 1 ^ be independent matrices of the same form as F„ . Then 
the matrices m^ +1 )/ 2 (F^ + ... + F^) and F^ have the same limiting eigen¬ 
value distribution p. More precisely, we have p = TL(a s (j^)), where crs(fyx) 


is the symmetric Bi-stable distribution with parameter (see Section 2.3) and 
is the associated rotation-invariant distribution on C (see Section 2.2). 


Let us note that for l = 0 and 1 = 1, we re-obtain the above-mentioned results 
from Tikhomirov and Timushev (45]. Moreover, as we will see in Section 3, a part 
from a possible permutation of the exponents ±1, the matrices F^ in Theorem 


1.3 


are the only examples of products of independent Girko-Ginibre matrices and their 
inverses such that for any m E N, F), 0 ^ and F^ 1 '* + • • • + F.[( r ^ have the same limiting 
eigenvalue distribution after appropriate rescaling. In particular, the matrices 

Ff := X« • • ■ X^Xf 1 ))- 1 • • • (X^+0)- 1 (1.7) 

with k > 1 do not share this property. 

However, the same limiting eigenvalue distributions may arise for products 
involving powers of random matrices: 

Theorem 1.4. Fix m E N, k E No and l\ ,...,4 EN, let l := l\ + ... + Z& and 

Ff := (Xf)(X«)-^ • (XW)-** , (1.8) 


where xi°\ X^, 


v(fc) 

i -A-n 


are independent random matrices as in (1.1) 
and let Fn\...,Fi'^ be independent matrices of the same form as F^. 
the matrices m _ ^ +1 )/ 2 (F^ + ... + F^) and F^ have the same limiting eigen- 


Then 


value distribution p, which is the same as in Theorem 1.3 


To obtain the preceding results, we apply the general framework from |j2l] for 
the investigation of (global) limiting spectral distributions to sums of products 
of independent Girko-Ginibre random matrices and their inverses (see Section (5j. 
Related results for various special cases can be found e. g. in 00 [13] [l5j [16] |l9j 
[23] [30] [35] [37] [43] [45]. In particular, in the Gaussian case, the limiting eigenvalue 
and singular value distributions of the products (1.7) were recently obtained in 1 
and 119], respectively. 

Furthermore, to identify the limiting spectral distributions, we use tools from 
free probability theory. Here it is worth emphasizing that for the matrices occur¬ 


ring in Theorems 1.3 and 1.4 the limiting spectral distributions may be described 
relatively explicitly. It seems that comparable results are available only in a few 
special cases, see e. g. [12, 26, 27, 33 . Let us mention, however, the very recent 


work [8, 41, 91 which provides an algorithm for calculating the Brown measures of 
general polynomials in free non-commutative random variables. This yields many 
further examples where the limiting spectral distributions may now be determined. 
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We present formal proofs of Theorems |1.3| and 1.4 in Section [3j after recalling 


some relevant facts from random matrix theory and free probability theory in 
Section [2j In Section [4j we point out that the limiting spectral distributions in 
Theorem |1.3| may be viewed as stable distributions with respect to an appropriate 
convolution © defined on a certain set of rotation-invariant probability measures on 
the complex plane, and we discuss some generalizations of Theorem |1.3| Section [5] 
is devoted to the proof of an enhanced version of Proposition [lTj viz. Theorem|5.4| 


In particular, combining the formal proofs from Section [3] with that of Theorem 5.4 


we obtain rigorous proofs of Theorems 1.3 and |1.4| see Section |5.8| for details. 
Finally, in Section |6j we compile a number of auxiliary results from the literature. 


2. Background 

In this section we collect some relevant concepts and results from the literature. 


2.1. Results from Random Matrix Theory. 

Given a random matrix F n of dimension n x n, let si(F n ) > • • • > s n (F n ) denote 
the singular values of F ra (in decreasing order), and let Ai(F n ),..., A n (F n ) denote 
the eigenvalues of F n (in arbitrary order). Then the probability measure 

n 

Vn ■= u(F„,) := ^ ^ 

3 = 1 

is called the (empirical) singular value distribution of the matrix F n , and if 
there exists a non-random probability measure up such that u(F n ) —> up weakly 
in probability, we call up the limiting singular value distribution of the matrices 
F n . Similarly, the probability measure 

n 

fi n :=/r(F n ) := 

3 =1 


is called the (empirical) eigenvalue distribution of F n , and if there exists a non- 
random probability measure [ip such that /i(F n ) —> ^p weakly in probability, we 
call ftp the limiting eigenvalue distribution of the matrices F,„. Following Girko, 
we will study the limiting eigenvalue distribution of the matrices F n by studying 
the limiting singular value distributions of the shifted matrices F n — al n , for all 
a € C. See Theorem 2T for a statement suited for our purposes. 

In doing so, we will often consider the Hermitian matrices 


V n : = 


O F 
F* O 


and 


— F F* 

n. • - J- n r 


( 2 . 1 ) 


Note that the eigenvalues of these matrices are given by ±si,..., ±s n and sf,..., 
respectively. For this reason, the probability measures /x(V n ) and /z(W„) will also 
be called the symmetrized and squared singular value distribution of the matrix 
F n , respectively. It is easy to see that knowledge of one of the distributions 
u(F„), n(V n ), n(W n ) (or its convergence) implies knowledge of the other two (or 
their convergence). More precisely, if S denotes the operator which associates with 
each distribution u on (0, oo) its symmetrization on M* and Q denotes the operator 
which associates with each symmetric distribution g, on M* its induced distribution 
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on (0,oo) under the mapping x H > x 2 , the operators S and Q are one-to-one, and 
we have the relations 

p(V n )=Sn(F n ) and p(W n ) = Qp(V n ) . (2.2) 

In the special case where F n = X^, n G N, it is well-known that /j(W n ) -A 7 


weakly in probability, where 


-!(ix) = — 


4 — x 


1(0,4) (x)X(dx) 


(2.3) 


This result is also known as the Marchenko-Pastur law (with parameter 1), and 
the measure 7 is also called the Marchenko-Pastur distribution (with parameter 1). 
Therefore, in the special case where F n = (X^) -1 , n G N, we have /i(W n ) v ~~ 1 


7 


weakly in probability, where 7 _i is the induced measure of 7 under the mapping 
x 1 — y x —1 . We will call this measure the inverse Marchenko-Pastur distribution. 
The distributions 7 and 7 -1 will serve as building blocks for more complex results. 


Also, for t > 0, let 7+ := 7 +1 := 7, and let 'yfi denote the induced measure 
of 7 under the mapping x eA (x + t)~ 1 x(x + t) -1 . (These notions are motivated 
by our regularization procedure in Section 5.) Note that 7+ 1 = 7 for all t > 0, 
while 7 t _1 -A 7^ 1 weakly as t -A 0. Finally, let us note that the S'-transforms of 7 
and 7 -1 are given by 

s ^ z) = ^TT 

respectively, see e.g. Section 8.1.1 in 


and 


V 11 


2 = — z . 


(2.4) 


21 


In the next theorem, the first part is a special case of a result which goes back 
to Girko (see also Bordenave and Chafai |14|), while the second part is taken 
from Section 7 in 1 21 1 . For a G C, introduce the Hermitian matrix 

O o/.l n 

dir). O 


•Jn(d) .— 


(2.5) 


and the Bernoulli measure 

B(a) := i<5_|, 

and note that B(a) is the eigenvalue distribution of J n (a). 


-| q | “ 1 “ 2^+\a\ > 


( 2 . 6 ) 


Theorem 2.1 (Convergence of Spectral Distributions). Let (F„) ne pj be a sequence 


of random matrices, let (V n ) ne N be defined as in (2.1), and suppose the following: 

(a) For each n G N, F n has size n x n. 

(b) There exists a non-random probability measure p-y on M such that for all a G C, 
p(V n + J n (a)) -A py ffl B{a) weakly in probability. 


(c) The random matrices F n satisfy the conditions (CO), (Cl) and (C2) from |21 . 

(These conditions are the same as in Condition C in Section 5.) 

Then the empirical eigenvalue distributions of the matrices F n converge weakly 
in probability to a limit pf, where pf is the unique probability measure on C 
such that 
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Moreover, the probability measure p-p is rotation-invariant, and with the notation 
from [211 and under regularity conditions, it has the Lebesgue density 


f(u,v) 


1 / dtp dip\ 

2^\ u d^ + v di) ' 


( 2 . 8 ) 


where ip is a continuous function on C* taking values in [0,1] and satisfying 
the equation 

^(a)(l - </>(«)) = -M 2 (l - V'(a)) 2 (5' v (-(1 - ^(a)))) • ( 2 - 9 ) 

Here, S\ denotes the S-transform of pv- Alternatively, we may write 


f(u,v) 


1 ip (a) (1 - ip (a)) 


7TI CkI 2 


1 — 2ip(a)(l — ip(a)) 


Sv(-(1 - ip(a))) 


( 2 . 10 ) 


2.2. Results from Free Probability Theory. 

To describe the limiting singular value distributions of the random matrices F„ 
in Proposition o we will use various concepts and results from free probability 
theory. See e.g. [IS, 36j for a thorough introduction to free probability theory, or 
Section 5 in 1211 for a brief introduction tailored to our purposes. In particular, 
we will use the free additive and multiplicative convolutions EB and IE, the asso¬ 
ciated R and S transforms (also for probability measures with unbounded support), 
and the asymptotic freeness of random matrices. Furthermore, we will frequently 
use the following result: 


Proposition 2.2 (Asymptotic Freeness). For each n £ N, let A„ and B n be in¬ 
dependent bi-unitary invariant random matrices of size n x n such that 

sup max |e( ^ trace(A„A*) k ), E("^ trace(B n B* ) k j j < 00 
neN ' ' > 


for all k £ N, and suppose that there exist compactly supported (deterministic) 
probability measures paa* and Pbb* on (0, 00 ) such that p(A n A*) —> paa* and 
M(B„B*) -A- pbb * weakly in probability. 


(a) The families {A n , A* } and {B n , B*} are asymptotically free, 
and (A„B ri )(A n B ri )* — > paa* E3 Pbb* in moments. 

(b) For any k,l £ N, the matrices (A^)*A^ and A^A^)* are asymptotically free, 
and for any k £ N, A^(A^)* —> p^ A * in moments. 

(c) The matrices V n {A n ) and V n (B n ) are asymptotically free, 
and V n (A n ) + V n (B„) —> pv(A) EB hV(B) in moments. 

(d) The matrices V n (A n ) andJ ri fa) are asymptotically free, 
and V„(A n ) + J n (a) -A Pv(A) EH B{a) in moments. 


Here, V(A n ) and V(B„) are defined similarly as in Eq. (2.1), and Pv(A) an d Pw(B) 
denote the corresponding limiting distributions. 


Here, parts (a) and (b) follow from the results in Section 4.3 in |28j, part (d) 
is proved in Section 5 in |2l], and part (c) follows from similar arguments. Also, 
let us mention that part (c) is already implicit in 45 . 
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Remark 2.3. Let us mention that Proposition 2.2 may be used to establish 
the weak convergence of the mean singular value distributions of the matrices 
A n B n , A(j and A n + B„. However, in most of the situations in which we will use 


Proposition 2.2 later, this already implies the weak convergence in probability of 
the singular value distributions of these matrices, see e.g. Section A.l in 1211. 


It is worth pointing out that there is another description of the density f(u, v) 


of the limiting eigenvalue distribution in Theorem 2.1 This description is due to 
Haagerup and Larsen 1 26 for probability measures with bounded support and 


to Haagerup and Schultz 27 for probability measures with unbounded support. 


Actually, in these papers, the density / is shown to describe the Brown measure 
of a so-called R-diagonal element in a W *-probability space. Roughly speaking, 
an R-diagonal element is a non-commutative random variable of the form uh , 
where u is a Haar unitary and h is positive element *-free from u. 

For our purposes, this description of the density / may be summarized as follows: 
In the situation of Theorem 2.1, suppose that the matrices W„ := F„F* have 


a limiting distribution /iw on (0, oo) which is not a Dirac measure and for which 


J log + t dfiw(t) < oo . 

Let Sw denote the 5-transform of (iw, and set 

F(t) := 1 


( 2 . 11 ) 


y/Sw(t - 1 ) 

Then F is a smooth bijection from the interval (0,1) to the interval 

(a, b) := x ~ 2 dv p(x)^ , ( J x 2 du f(x)^ 

(where l/oo := 0 and 1/0 := oo), and the limiting eigenvalue distribution /jl p of 
the matrices F n has a rotation-invariant density f(r) given by 

j {r) = 2vrr F'(F-i( r )) 1(a ’ 6) ^ ' 


( 2 . 12 ) 


Clearly, the connection to the above Theorem 2.1 arises from the fact that = F 
on the interval (o, b). 

Furthermore, Equation (2.12) shows that F -1 (r) = 2irs f(s ) ds, which implies 


that n w is uniquely determined by /j,f • Thus, we get a one-to-one correspondence 


between the set of all distributions gw on (0, oo) satisfying (2.11) and a certain set 


H of rotation-invariant distributions on C. Composing this correspondence with 


the operator Q introduced above (2.2), we obtain a one-to-one correspondence % 
between the set of all symmetric distributions /rv on M* such that 


log + |f| dfiv(t) < oo 


(2.13) 


and the above-mentioned set H of rotation-invariant distributions on C. It is easy 
to check that for any symmetric probability measure fj, on M* satisfying (2.13), 
we have 


R(D c /i) = V c U{v) 


( 2 . 14 ) 
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for all c > 0 , where T> c is the scaling operator which maps a probability measure 
on 1 or C to its induced measure under the mapping nAer. 

For random matrices F„ and V n as in Theorem 2.1, the correspondence % 


describes the relationship between the limiting spectral distributions /iv and 
i.e. we have the relation 


Pf = R(pv) • 


(2.15) 


2.3. Results on EB-Stable Distributions. 

Let us collect some results on EB-stable distributions which will be needed later. 
A distribution /r on M is called (strictly) Bl-stable if there exists a constant a > 0 
such that p mm = V m i/ a p for all m E N. Here, V c is defined as in Equation (2.14). 
We will often call the constant a the stability index of the EB-stable distribution p. 

The (strictly) EB-stable distributions have been investigated in | lT], 10 and ||6]. 
First of all, let us recall that for any EB-stable distribution, a E ]0, 2], We will need 
the following result, which is contained in 10, Appendix A] and | 6 |: 


Proposition 2.4. Fix a E ]0, 2]. For a symmetric probability measure p on M*, 
the following are equivalent: 

(i) p is (strictly) S-stable with stability index a. 

(ii) R/_i(z) = bz 1 *- 1 , where b E C* with arg b = — vr + aTt/2. 

(Hi) S[j(z ) = where b E C* with arg b = — n + a 7 r/ 2 . 

Moreover, in this case, the constants b in parts (ii) and (in) are the same. 


Here, for the 5-transform Sp,(z), we make the convention that we take arguments 
in ]— 7r, +7r] to define powers of b and arguments in (— 27r, 0) to define powers of z. 
Thus, we have S^z) E (0, oo)i when zG (— 1, 0), in line with the convention in 
Henceforward, we write cr s (a) for the (unique) symmetric EB-stable distribution 
with parameters a E ]0, 2] and b := e (- 7r +“ 7r / 2 ) 1 . Note that in the special cases 
a = 2 and a = 1, we obtain the standard semi-circle and Cauchy distribution, 
respectively. Furthermore, let us recall from 110, Appendix A] that the distribution 
cr s (a) has a continuous density f a such that f a (x) = 0( |x| _a_1 ) as |x| —> oo. Thus, 
in particular, the distribution tT s (a) satisfies Condition (|2. 13). 


21 


3. Formal Proof of Theorems 11.31 and 11.41 


In this section we give a formal proof of Theorem |1.3| in the Gaussian case 
which conveys the main idea without being cluttered by technical details. Indeed, 
by Proposition [13 once Theorem |1.3| is proved in the Gaussian case, it follows 
that the result continues to hold in the general case. 


The proof of Theorem 1.3 presented here is formal in that we use the concept 


of asymptotic freeness for random matrices whose ‘moments’ (in the sense of free 


probability theory) do not exist. Moreover, we use Theorem 2.1 purely formally 


without checking the assumptions. However, the argument can easily be converted 
into a rigorous proof by using the regularization procedure and the results from 
Section 5; see Section [5.8| for more comments. Similar remarks pertain to the proof 
of Theorem [Ll 
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Formal Proof of Theorem \ l.S\ Recall that we concentrate on the Gaussian case, 
i.e. we have F^ 0 -* = (Y ^ 1 ) _1 • • • (Y®) -1 , where Yn\ ■ ■ ■, Y® are inde¬ 

pendent random matrices of dimension n X n with independent real or complex 
Gaussian entries with mean 0 and variance 1/n. 

First consider the case m = 1, so that F n = F^. By the results from Section 2.1, 
we know that the limiting eigenvalue distributions of the matrices Yi 0 ^(Yi 0 ^)* and 
(Yn )) - 1 ((Y,^) -1 )* (r 7 ^ 0) are given by 7 and 7 -1 , respectively, with 5-trans- 
forrns given by (2.4). Since Y„°\ (Y^) -1 ,..., (Y ^) _1 are independent bi-unitary 
invariant matrices, it follows by “asymptotic freeness” (see Proposition 2.2 (a)) 


that the limiting eigenvalue distribution of the matrices W n from (2.1) is given 
by the 5-transform 

(-7 


5w(~) — 


z + 1 


Thus, the limiting eigenvalue distribution of the matrices V n from (2.1) is given 
by the 5-transform 


Sv(z) = 


l z + l(-z) 1 _ i i z (i~ i)/ 2 

V z z + 1 


In view 


of Proposition j2Tj the corresponding distribution is cr s (^ 1 ), the symmetric 
EB-stable distribution of parameter Hence, again by “asymptotic freeness” 

(see Proposition |2.2| (d) ), we find that for any a E C, the limiting eigenvalue distri¬ 
bution of the matrices V n + J n (a) is given by a s (7^-) EB B(a). It therefore follows 


from Theorem 2.1 and Equation (|2.15|) that the limiting eigenvalue distribution of 
the matrices F n 


is given by 


Now consider the case m > 1. Here we use that if F„ , 
bi-unitary invariant random matrices, their Hermitizations V,',' ,..., V’i" 1 '* (defined 


f!,"' * are independent 


as in (2.1)) are “asymptotically free” (see Proposition 2.2(c)). Thus, the matrices 


F n := m-(* +1 )/ 2 (F« + ... + FW) 
have the Hermitizations 

V n := m -(*+i)/ 2 ( V « + ... + v£">), 


with limiting eigenvalue distributions 


(07(771) 


*<(£)) = *<(z!t) 


l-\- 1 ' 


Here, T> c is defined as in Equation (2.14), and the last step follows from the fact that 
is EB-stable with stability index . Hence, again by “asymptotic freeness” 


M7+1) 

(see Proposition 2.2 (d)), we find that for any a£C, the limiting eigenvalue distri¬ 
bution of the matrices V n + J n (a) is given by 07 ( 777 ) EB B(a). It therefore follows 


from Theorem 2.1 and Equation (2.15) that the limiting eigenvalue distribution of 
the matrices F n is also given by 


□ 
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Formal Proof of Theorem l.f. Here the formal proof is almost identical to that of 
Theorem |1.3| The only difference is that in the first part of the proof (i.e. when 
m = 1), we additionally use Proposition ( |2.2[ ) (b) to see that the 5-transform of 
the limiting eigenvalue distribution of the matrices is given by 

S( z ) = (- z)~ l . □ 


Remark 3.1. In principle, the limiting density f(r) in Theorems 1.3 and 1.4 can 
be found using Equation (2.8). In our situation, it is easy to check that the equation 
for ip (a) reduces to 

ip{a){ 1 — ip (ce)) = |cr| 2 (1 — ip(a)) l+l . 

Thus, using that ip (a) is continuous with values in [0,1] and ip (a) / 1 for a « 0 
(see Sections 6 and 7 in 1211), we obtain, for l = 0,1, 2,3, 

o 

, ip 2 (r) = 1 - 
3 


ipo(r) = 1 A r 2 , ipi(r) = 

ip 3 (r) = 1 - 


1 + r 2 ’ \/l + 4 r 2 + 1 


(1 + v 2 (r) + w 2 (r)) 2 ’ 

and therefore 

1 2 

fo(r) = - 1 ( 0 , 1 ) (r ), fi(r) = —— , f 2 (r) = —= - 

7 r(l + r z ) z 71-Vl+ 4r 2 (l + 2r 2 + V1 + 4r 2 ) 

27 (v(r) + w(r)) 


fs( r ) = 


tt\J\ + 27r 2 (l + v 2 (r) + tc 2 (r)) 3 ’ 

1/3 


where we have set 
y (r) := \/4 + 27r 2 + 7 and w(r) := + 27r 2 — 

for abbreviation. 


1/3 



The limiting eigenvalue densities fi(r) (viewed along a line through the origin) 
for l = 0 (blue), l = 1 (yellow), l = 2 (green) and l = 3 (red). 

Also, let us mention that the paper [1| provides a stochastic representation of 
the limiting eigenvalue modulus distribution. □ 
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Remark 3.2. It seems natural to ask whether there exist further examples of 


i.(0) 


such that for any m G N, F® and + 


+ F^ have 


random matrices F 

the same limiting eigenvalue distributions after appropriate rescaling. However, 
it turns out that within the class of products of independent Girko-Ginibre matrices 
and their inverses, there exist no further examples beyond those mentioned in 
apart from possible permutations of the exponents ±1. Indeed, 


Theorem 1.3 


suppose that F^ is a product of p factors Y n' 1 and q factors (Y^) -1 (all of them 
independent, and in arbitrary order), and let W n and V n be defined as in (2.1). 
Then, arguing as in the formal proof of Theorem |1.3[ we find that the corresponding 
5-transforms S \y and 5v are given by 

{-z) q 


Sw(z) — 


and 5v(~) = 


[1 ^( 9—!)/2 


(1 + z)p ~ vv ~' (1 + zfa~ 1 ')l 2 ’ 

respectively, and by Proposition |2.4[ the latter is the 5-transform of a symmetric 
EB-stable distribution if and only if p = 1 and g 6 No. Now use the observation 
that if is not a rescaled version of /i, then is not a rescaled version 

of Ufa- □ 


4. Free Additive Convolution on C 


Roughly speaking, if ji\ and H 2 are two probability measures on the real line 
and A n and B n are Hernritian random matrices “in general position” and with 
limiting spectral distributions Hi and H 2 , then the limiting spectral distribution of 
the sum A n + B n is given by the free additive convolution hi EE3 H 2 - It is natural to 
ask the analogous question for non-Hermitian random matrices: If Hi and H2 are 
two probability measures on the complex plane and A„ and B n are non-Hermitian 
random matrices “in general position” and with limiting spectral distributions 
Hi and H 2 i does there exist a convolution hi © A*2 which describes the limiting 
spectral distribution of the sum A n + B n ? 

In the sequel, we will always assume that A n and B n are bi-unitary invariant. 
Then, in view of the results from Section 2, it seems reasonable to expect that the 
limiting spectral distributions Hi and H 2 (if existent) belong to the class H intro¬ 


duced above Equation (2.15). It therefore seems natural to restrict the definition 
of the convolution © to probability measures in this class. 

Hence, suppose that H\ and H 2 are two probability measures of class H and that 
A n and B n are independent bi-unitary invariant random matrices with limiting 
spectral distributions Hi and p, 2 , respectively. Also, suppose that these matrices 
satisfy the assumptions of Theorem |2.1| Then, if u\ and v -2 are the limiting 
symmetrized singular value distributions of A n and B n , we have p\ = %{V i) 


and ^2 = 'Ufa) by Equation (2.15). Furthermore, suppose that the matrix sums 
A n + B„ have the limiting symmetrized singular value distribution v\ 


V2 


(which seems very natural in view of Proposition 2.2) and that they also satisfy 


the assumptions of Theorem 2.1 Then, again by Equation (2.15), the associated 


limiting eigenvalue distribution is given by ’H(iq 
definition: 


I fa. This leads to the following 


Definition 4.1. Given two probability measures and p 2 of class H , 
set hi © ^2 := Hfa^fa) EH 
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Note that, by definition, we have 


u{v l mv 2 ) = u{v 1 )®u{v 2 ) 

for any symmetric probability measures v\ and v 2 on M* satisfying (2.13). 


(4.1) 


Remark. It seems a bit unsatisfactory that the above motivation relies (inter alia) 
on the assumption that the matrices A n , B n and A n + B„ satisfy the Conditions 
(CO), (Cl) and (C2) from Theorem 2.1 An alternative might be to work with 
matrices of the form U n T n V* . where U n and V n are independent unitary matrices 
of size n x n and T n are deterministic diagonal matrices of dimension n x n with 
positive elements on the main diagonal. The single ring theorem |24| 25, 


provides sufficient conditions for the convergence of the empirical spectral distribu¬ 
tions of these matrices, but it is also subject to certain technical conditions. Also, 
it is worth noting that the sums of independent unitary matrices have recently 
been investigated by Basak and Dembo [T]. 


Remark. The convolution © may also be interpreted in terms of free probability: 
Given and \i 2 in H , pick R-diagonal elements x\ and x 2 (in some Ik*-probability 
space) such that the Brown measure of x\ is fi\, the Brown measure of x 2 is g, 2 , 
and x\ and x 2 are *-free. Then © ji 2 is the Brown measure of x\ + x 2 , as follows 
from the results in 126, 271. 

It seems natural to introduce the concept of a (strictly) ©-stable distribution. 
Recall that T> c denotes the scaling operator on the class of probability measures. 


Definition 4.2. A probability measure /r of class H is called (B-stable if there exists 
a constant a > 0 such that yL® m = V rn \/„ii for all 


Similarly as above, we will call the constant a the stability index of the ©-stable 
distribution fi. Using Equations (2.14) and (4.1), it is easy to see that v is EB-stable 
if and only if T-Liy) is ©-stable. Therefore, the ©-stable distributions in H are in 
one-to-one correspondence with the symmetric EB-stable distributions on M*. 


Remark 4.3. Using the S-transforms of the symmetric EB-stable distributions 
(see Proposition |2.4[ ), the densities of the ©-stable distributions may be described 
a bit more closely by means of either (2.10) or (2.12). For instance, for a G (0,2), 
ip(r) is given by the unique solution in the interval (0,1) to the equation 

V>(r) 


(1 — ^(r))! 2 /") 


-i 


= r 


and f(r) is given by 


f( r ) = 


i/j(r)(l — ijj(r)) 
7rr 2 (! + (| - 2)'0(r)) 


Let us now turn to the question whether the ©-stable distributions arise as 
the limiting eigenvalue distributions of some random matrix models. As we have 
already seen in Section[3j by using products of independent Girko-Ginibre matrices 
and their inverses, we only get random matrix models for a = with l G No- 
However, for general a G (0, 2), we can still take a product consisting of a Ginibre 
matrix, a diagonal matrix and a unitary matrix: 
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Proposition 4.4. Let a £ (0, 2), let a := 2a/(2 +a) £ (0,1), and let a p (a) denote 
the positive Si-stable distribution with parameter a (see e.g. Section 4 in ID- Let f 
be a random variable with distribution cr p (a) IE B( 1), and let G be the distribution 
function of |£|. Let F n = Y n T n U*, where Y n is a Gaussian random matrix, 
T n is a deterministic diagonal matrix with the elements G'(^j-j-), j = 1,... ,n, on 
the main diagonal, U n is a random unitary matrix (with Haar distribution), and 
Y n and U n are independent. Then n(F n ) —> TL(a s (a)) weakly in probability. 

Here and below, the free multiplicative convolution v Kl /x of a distribution v 
on (0, oo) and a symmetric distribution /i on M* is defined as in |6|. Then v [X3 /x 
is again a symmetric distribution on M*, and by Lemma 8 in [6|, we have 

Q(u IXI fi) = v IXI Qn Kl v . (4-2) 


Proof of Proposition 4-4 ■ Fix t > 0, set f(t) := (£ A t) V (— t), and let T n (t) and 
F n (t) be defined as in the proposition, but with £ replaced by f(t). Additionally, 
let V n (t) and W n (t) be defined as in ( |2.1[ ). Clearly, the matrices T n (t)T n (t)* are 
deterministic with ju(T n (t)T n (f)*) —> £(^(t) 2 ) weakly. Moreover, it is well-known 
that /i(Y n Y*) —> 7 weakly almost surely. Since the matrices Y n are bi-unitary 
invariant, it follows by almost sure asymptotic freeness (see [28, Section 4.3]) that 

li{W n {t)) —> 7 IEI £(£(f) 2 ) weakly almost surely. 

Also, since the matrices Y n T n U* are bi-unitary invariant, it follows by almost sure 
asymptotic freeness (see |28| Section 4.3]) that 

Ai(V n (t) + J n (a)) -A Q~ l {+ Kl C(f(t) 2 )) EEI B{a) weakly almost surely, 

for any a £ C. Now, it is easy to see that for any e > 0, there exists some t > 0 
such that rank(T n — T n (t)) < en and therefore rank(F n —F„,(t)) < en for all n £ N. 
This implies 

MW n ) —> 7 IXI £(£ 2 ) weakly almost surely 

as well as 

p.(V n + J„(a)) -A Q ~ 1 (7 Kl T(M)) ffl B(a) weakly almost surely, 

for any a £ C. 

We will show that 

Mv = Q" 1 ( 7 B£(£ 2 )) = *»(«)■ (4.3) 

It is well-known that the S-transform of a p (a) is given by where b is 


the same as in Proposition 


2.4 


and that the S-transform of B(l) is given by 


Thus, the S-transform of f 2 is given by 

/ 2(1/3)-! 


si{z) = 


i 


b l /° 


z + 1 


s (2/5)-2 

b 2 / a 


A2/a)-l 

b 2 / a 


and the S’-transform of /iv is given by 
S v (z) = \/^^SwM) = \l 


z + 1 1 zl 2 /")" 1 

z z + 1 b 2 / a 


b V“ 


which proves our claim (4.3) by Proposition 2.4 
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stable distribution a p (a ) has a density which 
Theorem A. 1.4] and which is of 


10 


Theorem A.2.1], it is straightforward to check 


Using the fact that the positive 
vanishes in a neighborhood of the origin 
order 0(x ~ a_1 ) as x —> oo 
that the matrices T„U* satisfy Condition C^mpie introduced in Remark 5.1 below. 
Thus, it follows from Lemma 5.12 below that the matrices F„ = Y„T„U* satisfy 

We may therefore invoke 
H(a s (a)) weakly in probability. □ 


the conditions (CO), (Cl) and (C2) from Theorem 2.1 
this theorem to conclude that yu(F n ) 


Remark 4.5. Proposition |4.4| is closely related to an observation in Arizmendi 
and Perez-Abreu [6 which states that 

<7s(g 0 = U'p(Q') Kl U"Wigner j (4-4) 


where 07 (a) and 07 (a) denote the symmetric and positive EB-stable distribution 
of parameter a and a, respectively. In fact, using (4.2) and the random variable £ 
from above, we have 


Q(a p (a) Kl (Twigner) = o>(a) Kl 7 Kl 07(a) 

= 7 Kl (a p (ot) Kl 5 \ Kl a p {a)^j = 7 Kl Q(a p (a) Kl R(l)) = 7 Kl £(£ 2 ), 

which shows that the relation (4.4) is equivalent to the relation (4.3) checked in 
the preceding proof. □ 


5. A General Limit Theorem for Sums of Products 
of Independent Random Matrices 


5.1. Overview. In this section we prove a general result (see Theorem 5.4 below) 


about the limiting singular value and eigenvalue distributions of sums of products 
of independent Girko-Ginibre matrices and their inverses. In particular, this result 
contains Proposition 0 from the introduction, and it allows for a rigorous proof 


of Theorem 1.3 To derive Theorem 5.4, we apply the general framework from 21 


In Subsection 5.21 we summarize the technical conditions and the main univer¬ 


sality results from 21 to make the presentation self-contained. In Subsection 5.3 


we state Theorem 5.4 Subsections 5.4 - 5.6 prepare for the proof of Theorem 5.4 


by verifying the technical conditions from 21 . Subsection 5.7 contains the proof of 
Theorem |5.4| Finally, in Subsection 5.8 we sketch the rigorous proof of Theorems 


P and 11.41 Some relevant results from the literature are collected in Section [ 6 l 


5.2. General Framework. We consider random matrices of the form 

m ml 

F„ := £ F<?> := £ ]([( x «»~, 

q= 1 q= 1 r =1 


(5.1) 


where m G N, l £ N and £\,...,£/ 6 { —1,+1} are fixed and the X„ are m- 


49) 


dependent Girko-Ginibre matrices as in the introduction. A major step in 21 


is 

to prove the universality of the limiting singular value and eigenvalue distributions, 
i.e. to show that these distributions (if existent) do not depend on the distributions 


of the matrix entries apart from a few moment conditions as in ( 1 . 2 ) 
To state this more precisely, we need two sets of random matrices. 


(1.4). 
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To this end, it seems convenient to view F n as a matrix function (by slight abuse 
of notation) and to write 


F n (Z«,...,Z^)) := VTT(Z 


q— 1 r =1 


((<?—! )l+r)y- 


(5.2) 


where m G N, l G N and G {— 1,+1} are the same as in (1.5) and 

zi 9 ^ = (Z^)jk=\ ! ... ; n is a matrix in the indeterminates Z^jj , q = 1,... ,ml. Then, 
we may write F„(X) := F„(X. 


(i) 


the random matrices xl 9 ^ : = 

>r the correspon 

Y, (9) := (^yjk)j,k=i,...,n- We always assume that the families (Xj^)j,fc, g eN and 

are defined on the same probability space and independent. When 

the choice of the matrices xf, 1 - 1 ,..., x[, m ^ is clear from the context, we also write 
F n instead of F„ (X). 


l 


^ n ■— y^rl^jk )j,k=l,...,n 
for the corresponding random matrices built from the Gaussian random matrices 

dsli 


( 9 )', 


,xi m °) 


for the random matrices built from 
and F n (Y) := F^Y^,..., Y^ l) ) 


Remark. More generally, using the arguments from this section, we might deal 
with matrix functions of the form 

m m lq 

F„.:=^FW :=^[](zHr-, 

q =1 q— 1 r= 1 

where £ q)T G {+1, —1}, the indices i q ^ r G N are pairwise different, 

and all parameters do not depend on n. That is to say, the numbers and the types 
of the factors in the m summands need not be the same. 


In our investigation of the limiting spectral distributions of the matrices F n , 
we will also consider the shifted matrices F n — oT n , with a G C, the regularized 
matrices F nt , with t > 0, and their combinations F n ^ — al„. Here, the regularized 
matrices Farise from the regularized matrix functions 


Fn,t(z£\ ■ • •, Z^)) := ^(Z^- 1 )^)) 

q= 1 r =1 


(5.3) 


where (Z n )f := Z n for e = +1 and (Z n )f := (Z*Z n + tl n ) 1 Z* for £ = -1. 
Note that, by definition, the regularization has no effect when e = +1 and that 
lim^o(Z n )t" 1 = (Z n ) _1 when Z n is invertible. 

Furthermore, fix a sequence (r ra ) n6 N of positive real numbers such that r„ AO 
and r n y/n —> oo, and set 


Xj 9) := x[fj) 1 


ft "fl^l <TnVF} 


y(9) ._ y(9) i 

ft ' ft 


(. j,k,q € N), 

U'jfc l-'«v 

z jk(<p) '■= ( cos V>) Xjk + ( sin <p) Yjk ] ti, k, q G N; 0 < if < f), 

and for n G N and 0 < (p < §, set Z^\ip) := (-±=Z^f (tp))^(q = 1, • • ■, ml), 

F n (ip) := Fn(Zn\tp), .^., Z^ mi) (</?)). Note that F n (0) = F n (X), F n (f) = F n (Y), 
where F n (X) and F n (Y) are defined analogously to F n (X) and F n (Y). 
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For nGN, 0<<y?<f and 2 £ C + , introduce the Hermitian matrix 


V„(¥>) : = 


O 

F,»* 


Fn(v 7 ) 

O 


and the traces 


gtfk ■= trace 


g\k ■= trace 


dV n (<p) 


d Re Z 


( 9 ) 


(^ ^ n(y , ) Zi-2n) 


-2 


jk 

dV n {<p) 

dim Z^f 


(V„((p) - zl 2n ) 


-2 


The dependence onn£N, 0<(/?<5 and z £ C -1- is implicit here. Also, 


when taking partial derivatives, we view F r 


(Z { n\. 


r(ml) 


) as a function of the 


indeterminates Z^j} (the elements of the matrices Z^). The same convention 
applies to partial derivatives such as dg^}/d Re zj^, dg^/d Re Z^j} etc. Finally, 
for 0 < 9 < 1, let g$(9), 6 ), dg$(9)/dRe Z$, dg$ (9)/dRe Z$, etc. 

denote the functions obtained from g^), , dg^/d Re zj^, dg^j}/d Re Z.-^, etc. 
by replacing zj^(^) with 9Z^(ip). 

Given a sequence of random matrices F n as in (5.2) and a constant t > 0, 
we denote by F„.^ the associated regularized random matrices as in (5.3). With 
this notation, we have to check the following Conditions A, B and C: 

Condition A: 

For F n = F n (X) and F n = F„(Y), the matrices F n satisfy the following condition: 

For each a £ C and z £ C + , we have lim^o limsup n ^. 0O | s n j(z) — s n (*)| = 0 
in probability, where s n (z) and s n j(z) are the Stieltjes transforms of the Hermitian 
matrices (F n - aI„)(F„ - al n )* and (F n>t - aI n )(F ntt - al n )*, respectively. 

Condition B: 

For each t > 0, a £ C and z £ C + , the functions g^j} (0) (0 < 6 < 1) associated 
with the matrix functions F n t — al n satisfy the following bounds: 


sup 

j,k,q 




( 9 ) v (q)' 




sup max 

j,k,q 


sup max 

j,k,q 


{IK 


{IK 


jk 

M) 


jk 


< A 0 


(BO) 


dg)l’(0) 


dRe Z 


( 9 ) 


y(q) y(q)' 

^jk ’ x jk 


f d 9jk( 0 \ x (q) 


E 


jk 


1 dim Zjf 


( 9 )' 


Y 

jk ’ jk 


}U 


< a, 


(Bl) 


d 2 g$(0) 


d(Re Z^f 


v(q) 

^jk ’*jk f 


d 2 9j g k(0) 


E 


■ d(Im Zf k 


(9)^2 


v(q) v*A>\ 

^jk > Y jk / 


El 


d 2 g%\9) 


dRe zjf dim Zjf 


X 


( 9 ) 


jk 




< A 2 (B2) 


Here Ao,Ai,A 2 are certain constants which may depend on t > 0, a £ C and 
z £ C + but not on n £ N, ip £ [0, |] or 9 £ [0,1]. Furthermore, similar bounds 
hold for the functions g^}(9) (0 < 9 < 1) and their partial derivatives. 
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Condition C: 

For F n = F„(X) and F n = F n (Y), the matrices F n satisfy the following conditions: 
(CO) There exists some p > 0 such that 

1 n 

k= 1 

is bounded in probability as n —> oo. 

(Cl) For any fixed « 6 C, there exists some Q > 0 such that 

lim p(s n (F n - al n ) < n~ Q ) = 0. 

n—>oo \ / 

(C2) For any fixed a E C, there exists some 0 < 7 < 1 such that for any 
sequence (<5 n ) ne pj with 5 n -A 0, 

lim pf — V I logs ? (F n — al n )| > e^) = 0 for all e > 0, 

n—>00 \n z —' / 

ni<j<ri 2 

where n\ = [n — n5 n } + 1 and 77,2 = [n — n 7 ]. 


Remark 5.1 (Condition C s i mp i e ). It will be convenient to consider Condition C 
for more general matrices F n than in (5.1). Thus, if a sequence of random matrices 
F n (with F n of dimension n x n) satisfies Conditions (CO), (Cl) and (C2), we say 
that the matrices F n satisfy Condition C. Also, if a sequence of random matrices 
F„ (with F n of dimension n x n) satisfies Conditions (CO) as well as Conditions 
(Cl) and (C2) with a = 0, we say that the matrices F n satisfy Condition C s i mp i e . 


The following result is essentially contained in 21 


Theorem 5.2 (Universality of Singular Value and Eigenvalue Distributions). 

Let F n (X), F„(Y) be defined as above, and let u n (X.), v n (Y) and /7 n (X), /r n (Y) 
denote the associated singular value and eigenvalue distributions, respectively. 

(a) If Conditions A and B hold, we have 

z/ n (X) — v„(Y) —> 0 weakly in probability. 

(b) If Conditions A, B and C hold, we have 

/r n (X) — p n { Y) -A 0 weakly in probability. 


Proof. 

(a) Set a := 0. For Z = X and Z = Y, let m n (z;Z) and s n (z; Z) denote 
the Stieltjes transforms of the Hermitian matrices 


V n (Z) 


o F„(Z) 

F n(Z) O 


and W n (Z) := F n (Z)F) t (Z), 


and let m n j(z] Z) and s n j(z; Z) denote the corresponding Stieltjes transforms when 
F„(Z) is replaced with F n ^(Z). Fix t > 0. By Condition B and Theorem 3.2 
in 21 , we have, for each z E C + , m n j.(z;X.) — m n j(z; Y) —> 0 in probability 
and therefore s ni t(z;X) — s n j(z; Y) —> 0 in probability. It therefore follows from 
Condition A that, for each 2: E C + , s n ( 2 :;X) — s n (z; Y) -a 0 in probability, which 
implies the claim. 
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(b) By the same argument as in (a), the conclusion of (a) holds not only for 
the singular value distributions of the matrices F n , but also for the singular value 
distributions of the shifted matrices F„. — al n , for any fixed a£C. Thus, the claim 
follows from Condition C and Remark 4.2 in 121 . □ 

Remark 5.3. As follows from the proof, if one is only interested in the limiting 
singular value distributions of the matrices F n , it suffices to assume that Conditions 
A and B hold with a = 0. 


5.3. A General Limit Theorem. We will use Theorem 15.21 to establish the 


following limit theorem, which contains Proposition 1.1 from the introduction 


Theorem 5.4. Let the matrices F„(X) be defined as in (1.5). Then there exist 


non-random probability measures v and p on (0,oo) and C, respectively, such that 
lim p n (F n (X)) = v weakly in probability 

n—l-oo 

and 

lim /r n (F n (X)) = p weakly in probability 
n—>oo 

and the limiting distributions are the same as those for the matrices F„(Y) derived 
from Gaussian random matrices. More precisely, the measure v is given by 

EBra 


Sv = (Q ( 7 ' 


17 




with S and Q as in ( 2 . 2 ), and the measure p is the unique probability measure 


V. as in (2.15)) 


on C satisfying (2.7), with pv replaced by Sv {or, equivalently, p = Tl{Sv), with 


The proof of Theorem 5.4 will be given below in Subsection 5.7 


The main 

idea is that the result is true for the matrices X^ and their inverses (X ^)^ 1 


(see Section 2.1) and that the corresponding result for the matrices F n (X) follows 
from this by means of induction on l and on m. To establish the existence of the 
limiting distributions in the Gaussian case, we will use tools from free probability. 
To extend this existence to the general case and to establish universality, we will 


use Theorem 5.2, of course, which requires us to verify Conditions A, B and C. 
For this purpose, we provide some auxiliary results in the next 3 subsections. 


5.4. On Condition A. Let F n = F n (X) be defined as in ( |1.5[ ). In order to obtain 
a matrix function which is smooth in the matrix entries (as needed for Condition B), 
we replace all inverses (X ^) _1 with regularized inverses (XW)^ 1 . We do this in 
a step by step fashion. Hence, fix t > 0, fix an index Q such that £q = —1, and 
for all the other indices q with e q = — 1 , fix a choice between (X *^)^ 1 and (X^)^ -1 . 
Then the resulting matrix F n may be represented as 

F n = A n (X n ) 1 B n + C n , 

where X n = X^ (we omit the index Q for simplicity). 


(5.4) 
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Fix a£C, and for 0 < u < t, let 

F n ,u = A n (X ri ) u 1 B n + C n := A n (X*X n + u) 1 X*B n + C n , (5-5) 

and 

Sn,u(z) ■— — trace ((F nu ol I n )(F nu cxl n ) z) • (5.6) 

Note that F ?li o coincides with F n if X n is invertible. Then, by way of induction, 
it will suffice to prove the following lemma: 


Lemma 5.5. For each n 6 N, let X n = (^^Xjk)jk=be a matrix as in (0), 
where the entries Xjk are independent random variables satisfying (1.2) - ( |1.4[ ). 
Furthermore, for each n E N, let A n , B n and C n be random matrices of dimension 
nxn such that the singular value distributions of the random matrices B„ and C n 
converge weakly in probability to (non-random) probability measures on (0, 00 ), and 
let F„ iU and s njU (z) be defined as in (5.5) and ( |5.6| ). Then, for any z = u+iv G C + , 
we have 


lim lim sup \s Ui t(z) - s n ,o(z)| = 0 

t ^0 rt.—a 


in probability . 


(5.7) 


Remark 5.6. Let us emphasize that although the matrices A n , B n , C n and X Tj 


in the decomposition (5.4) are independent, this is not required in Lemma 5.5 


Remark 5.7. Lemma 8.16 in [21 1 contains a similar result for the case where 
C n = 0. This result is based on the additional assumption that the matrices B ?l 
satisfy Condition C, but as we shall see below, this assumption is not needed. The 


main difference in the proof of Lemma 5.5 (as compared to that of Lemma 8.16 


in 1211) is that we control the necessary auxiliary modifications of the matrices B, 
and C n via the matrix rank, and not via the resolvent. 


Proof of Lemma 5.5 For the sake of simplicity, we consider only the case a = 0 
here, the extension to the case a^O being straightforward. We have to show that 
for any given e > 0 and 5 > 0, 


lim sup lim sup I 

t —>-0 n —>00 


\Sn,t{z) - Sn,o(z)| > s) < 5 . 


(5.8) 


Hence, fix e > 0 and 5 > 0. Similarly as in the proof of Lemma 8.16 in |21], 
we introduce auxiliary modifications of the matrices B n and C n before we do 
the regularization of the inverse matrices X^ 1 . 

For an nxn matrix M, let si(M) > • ■ ■ > s n (M) denote the singular values. 
Since the singular value distributions of B„ and C n converge weakly in probability 
to (non-randonr) probability measures on (0, oo), we may find K > 1 and JVeK 
such that for n > N, we have 


sX 1 

, k =1 


1 V Sk(Bn)>K} 


> A” V f Vi 

^ 24 v n 


\ £V 

{s k (C n )>K} > 24 


< $ 
' 2 


k= 1 


Then, the modifications B n and C n are defined as follows: For the matrix C n , 
take the singular value decomposition C n = U AV* , let A be the diagonal matrix 
obtained from A by replacing the diagonal elements A ^ with A^.fc := A kk A K, 
and set C n := UAV*. For the matrix B n , take the singular value decomposition 
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B„ = UAV*, let A be the diagonal matrix obtained from A by replacing the 
diagonal elements A^ with A^ := (A*.*. A K ) V K , and set B n := UAV*. 
Then we have 


|B n || < K , 


|| < K , 


|C„|| < K, 


(5.9) 


and for n > IV, with a probability of at least 1 — we also have 


^ rank(B„ - B„) < gf , ± rank(C„ - C n ) < §| 


(5.10) 


Furthermore, let F UjU and s n ^ u 
and C n replaced by B n and C, 
a probability of at least 1 — |, 


(z) be defined as in (5.5) and (5.6), but with B n 
n . It then follows from (5.10) that for n > IV, with 
we have 


1 

n 


rank(F UiU F* iU 


£V 

6 


and therefore, by the rank inequality, 


\s n ,u(z) - s n , u (z)\ < |. 


Thus, we have reduced the proof of (5.8) to showing that 


limlimsup |s n! t(^) — Sn,o(")| = 0 in probability . 

t —'*0 n —»oc 


(5.11) 


Since we only deal with the modified matrices for the rest of the proof, we omit 
the tildes and write B„, C n , F, hU and s njU (z) instead of B„, C n , F n . u and 's n , u {z ), 
respectively. Moreover, for brevity, we usually omit the index n. 

To establish (5.11), we may proceed similarly as in the proof of Lemma 8.16 
. Set R n := (F U F* — z\)~ l , 0 < u < t, and note that we have the estimates 


m 


21 


||Ru||2 < v x , ||f*r u fj 2 <i + \z\v x , 

IIRuFull < (tT^I + \z\v~ l )) l/2 , ||F*R U || < (tT^I + \z\v~ 1 )) 112 (5.12) 
as well as the representation 

Rt — R 0 = f d ^du = -f r / (F ; F “ } R u du . (5.13) 

Jo du Jo du 

It is easy to check that 

= AX ^( XX * + ui y lBF *n + F„B*(XX* + uI)“ 1 (X' 1 )*A* 

= AX“ 1 BB _ 1 (XX* + uIJ^BF* 

+ F U B*(XX* + ?xI) _ 1 (B*) _ 1 B*(X~ 1 )*A* 

= f„b _1 (xx* + iT)~ 1 bf; - cb _1 (xx* + ^i)- 1 bf; 

+ F„B*(XX* + rtI) _ 1 (B*) _ 1 F* - F U B*(XX* + «I) _ 1 (B*) _ 1 C* . 
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Thus, it follows from (5.13) that 


+ 


+ 


^ trace(R t - R 0 )| < [ trace(R u F u B 1 (XX* + uI) 1 BF*R U )| du 
Jo 

f | J trace(R u CB _ 1 (XX* + 'uI)~ 1 BF*R u )| du 
Jo 

I \J trace(R I 1 F, u B*(XX* + uI) _ 1 (B*) _ 1 F*R u )| du 
Jo 

+ [ \J trace(R tl F u B*(XX* + «I) _ 1 (B*) _ 1 C*R U )| du . 

Jo 

Using the inequality | trace(MiMoM 3 )| < 111VI 1 1111A/I 3 11 trace(M 2 ) (which holds 
for any n x n matrices Mi, M 2 , M 3 such that M 2 is positive definite) as well as 
(5.9) and (5.12), we therefore obtain 


| J trace(Ri — R) | < C ( K , z) I 4 trace(XX* + iil) 1 du . 

Jo 


(5.14) 


where C(K,z ) is some constant depending only on I\ and z. Thus, it remains 
to show that 

lim limsup / 4 trace(X n X* + ul n )~ l du = 0 in probability . (5.15) 

t —^0 tl —^00 Jo 

But this follows from the fact that the random matrices X n satisfy Condition C; 
see the proof of Lemma 8.14 in |21 for details. □ 


5.5. On Condition B. Here we prove the following lemma: 


Lemma 5.8. With F n defined as in Equation (1.5), Assumption B holds. 


Proof. For simplicity, we consider the case of real matrices only, and we often omit 
the arguments 99 and 9 in our estimates. Furthermore, for brevity, we will assume 
that t £ (0,1) and v := Im z £ (0,1). (Indeed, it would be sufficient to deal with 
parameters from these regions.) Finally, for reasons of symmetry, we consider only 
the case where q £ {1 ,..., l}. 

Putting 

(ZM)'' := Z« for £ r = +1 

and 

(ZW)f r := A$(Z£>)* : = ((z£>)* Z W + tl)~\Z^)* for = -1 
(r £ N), we have the representation 

m l 

F n,t = F n)t (Z«,..., Z^O) = Yl(Z { y- 1)l+r) Yt r • (5.16) 

p= 1 r =1 

Setting H,^ := I]?=i(Z^)t r and := (Ilt=g+i(Zra' ) )t r )*, it follows that 
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where 


and 


<9(zg)^ 


dZ) 


(9) 


= e,e 


j*k 


T for e a = +1 


jk 


d(zg)^ 

(9) 


Ag(e fc ejzg + (ZMyejet) A$(zg)* + A$ 


dZ ik 

Thus, in both cases, we have a representation of the form 

3{Z[ 


‘.t e k e J for £ q = -1 


r(q)\ e i 
J n )t 


dZ 


(9) 


= VlVj + ... + v s v s , 


(5.18) 


jk 


where s G {1,3} and the v* and the v; are vectors of Euclidean norm bounded 
by t~ 1//2 . To see this, recall that 0 < t < 1 and use the relations 


(9)1 


,,t M2 


<t~\ iizgAg(zgrn 2 <i, 


l (9) 


(Zgr|| 2 <rV 2 , ||ZgAg|| 2 < r 1/2 . (5.19) 


O F 


O 


F* O 


_ F n,iO) -al n 

O 


Let V denote the Hermitization of the matrix F := F ~ aln, be. 


V = 


and for fixed z = u + iv G C + with v G (0,1), let R := (V — zl 2n ) -1 denote 
the corresponding resolvent matrix. Furthermore, given a matrix M of dimension 
2 n x 2 n, we denote the submatrices of dimension n x n by [M] a ^, a,f3 = 1,2, 
so that 

[M] n [M] 12 ‘ 

[M] 21 [M] 22 


M = 


Then yg is a finite sum of scalar products of the form 

v*(Hg)*[R 2 ] 21 Hg Vi and v*(Hg)> 2 ]i 2 Hgv, 
with Vj, Vj as in Equation (5.18). Since ||R|| < u^ 1 , it follows that 
.(9) 


\9% ] m < cv- 2 J2 • 


(5.20) 

(5.21) 


(r) 

Let Z n be a random matrix of the same form as the matrices Z n . Then it is easy 
to see that for any r G N, there exists a constant C r G (0, 00) such that for any 
n G N and any deterministic vector v n G M n , we have 


as well as 


E||(Z r 


\-i. 


■ ii 2r < r iiv ii 2r 
nII2 — W|| v ri112 

(5.22) 

r II2 r < (-t 11 ||2r ur 

n || 2 — v n||2 / 6 • 

(5.23) 


In fact, (5.22) can be proved using our moment assumptions and independence, 
while (5.23) is an immediate consequence of the fact that ||(Z n ))T 1 || < t^ 1 / 2 . 
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Using Cauchy-Schwarz inequality, independence as well as (5.22) and (5.23) 
(applied conditionally on ), we obtain 




< Cv 


-2 


£ ( e { IIH^Vj 111 | X^,Y^})'' 2 ( e { ||H<?> 


' v dli 


y(9) w(9)\V /2 

^jk ’ Y jk /) 


< cv - h - q -^ y , ( E {ii vi ii2! x “v“}) 1/2 ( E {n^ii2! r “}) 


-(«) w(<?)\V /2 


< ChT 2 ^ 1 )/ 2 , 


(5.24) 


and Condition (BO) is proved. 
Furthermore, using that 


<9R „ 5V „ 

= —R—rvR, 


az 


( 9 ) 


jk 


dZ 


( 9 ) 




it is easy to see that 

Yjt_ 

sz\ t 


= trace ( —2 


5V 

azf 


R/ 


av 

azf 


R + 


a 2 v 


d(Z, 


C<?)a2 


R 1 


jk 


and 


d 2 g 


(g) 

jk 


d(Z 


(q)\2 


= trace 6 


jk 


- 3 


av 

azfj 
a 2 v 

7 ( 9 ) \ 2 


R 2 


av av 

R 


9zj«> 0Z$> 


R 


9(ZJ) 2 9z‘f 


2 av „ a 2 v „ av o c v o 

R 2 -R - 3 —— R -R 2 H - — — R 2 


a 3 v 


d(z$) 2 dZ 


where, for k E {1,2,3}, 


s(zfjr " s(zj?)“ ” 


( 9 ) 

jk 


9(Z««>)3 


and 


a K (z^)^ 


a(sjf) 


E V -'d V i,2 


Vj,2K-lVj )2/t 


where the sum is finite (with a number of summands which does not depend on n), 

Vj,l, • • • , 2 k £ {A n,t&ki 5 5 A n ^e^., ©j , ©&} 

and 

II,,. II M,. || — (k+1)/2 

||V^i||2 * * ‘ ||V i>2 «||2 St 1 n • 


Therefore, using Holder’s inequality, independence as well as (5.22) and (5.23) and 
proceeding as in (5.24), we find that the conditional expectations given 
of dg^j} (d)/d(Zj q J) and d 2 g^ (6) / d(Z^) 2 are bounded by expressions of the form 
Cv~ 3 t~^ l+1 ' ) and Cv~H~ 3 ^ l+1 ^ 2 , and Conditions (Bl) and (B2) are proved. □ 
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5.6. On Condition C. Here we provide a number of lemmas which will be helpful 
in verifying Conditions C and C s i mp i e . Recall that Condition C s i mp i e was introduced 
in Remark 15.11 

Lemma 5.9. For each n G N, let F n and G n be random matrices of dimension 
nxn. If the matrices F n and G n satisfy Condition C s i mp i e , then the matrix products 
F n G n also satisfy Condition C s i mp i e . 


Proof. We use similar arguments as in the proof of Theorem 8.22 in 21 . Condition 


(CO) follows from Corollary |6.2[ Cauchy-Schwarz inequality, and Condition (CO) for 
the matrices F n and G n . Condition (Cl) with a = 0 follows from Theorem | 6 .1 1 and 
the fact that the matrices F n and G n satisfy Condition (Cl) with a = 0. Thus, it 
remains to check Condition (C2) with a = 0. Suppose that 0 < 7 < 1 and 5 n —> 0, 
and set n\ := [n — nS n ], ri 2 := \n — n 7 ] as usual. We will show that for ± G {+, — 

log ± Sj(F n G„) 


1 Y 

n / j 
ni<j<n 2 


0 in probability. (5.25) 

For the positive part, this follows from the fact that the matrices F ra G n satisfy 


Condition (CO). For the negative part, note that by Theorem 6.1, we have 


Sj(F„G„) > J] Sj( F n ) • J] Sj(G n ) 
j=k j=k j=k 

for k = l,...,n. Thus, taking k := max{ni,min-jj : Sj(F n G n ) < 1}} and using 
that the matrices F n and G n satisfy Conditions (Cl) and (C2) with a = 0, we get 

n 2 




ri2 

1 


^ log Sj(F n ) + ^ y log Sj(G n ) + op(l) = op(l), 


3=ni 


j=m 


3 =ni 


and the proof is complete. 


□ 


Lemma 5.10. For each n G N, let X„ = (^Xjk)jk=i,...,n a matrix as in O), 
where the entries Xjk are independent random variables satisfying (1.2) - (|1.4|). 


Then the matrices X n and X n 1 satisfy Condition C. 

Proof. To shorten notation, we omit the index n throughout this proof. 

For the matrices X, Condition C is checked in |23| (in fact, it follows from 


the relation E||X ||2 = n and from Lemmas 6.5 and 6 . 6 ), and for the matrices X 


Condition C follows essentially from the arguments in the proof of Theorem 8.22 
in 121 . For the convenience of the reader (and since we refer to the proof later), 
let us provide some details for the matrices X -1 . 

For Condition (CO), see the proof of Theorem 8.22 in 21 . We now check 
Conditions (Cl) and (C 2 ) with a = 0. Condition (Cl) follows from the relation 
s n (X _1 ) = sj _ 1 (X) and Condition (CO) for the matrices X. For Condition (C2), 


let n\ = [n — nd n ] < [n — n 1 7 ] = n?, where 5 n > n 7 , 5 n —> 0. Similarly as 


in (5.25), we consider the positive and negative part separately. Since the matrices 


X satisfy Condition (C2) with a = 0, we have, for n large enough, 


n 2 


3=m 


n 2 

k y io s + s i ( x_i )=«e io s - •‘’■n-j+i ( x ) < k y io s~ s j( x ) =°p( 1 )- 

j=n 1 


n 2 


J=n 1 
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Moreover, suppose that the matrices X satisfy Condition (CO) with exponent p. 
Then, since \ogx/x p is decreasing in x for x > e 1 ^, we have, for n large enough, 

n 2 n 2 

S £ lo S _S i( X X ) = l Y2 log + Sn_j+l(X) 


3=m 


3=111 


< - 


Y log + S n _ j+ i(X) + i Y log + Sn_j'+l(X) 


J=ni,...,ri2 

Sn—j +1 (X)<(5 n 


3 = 711,...,712 
Sn—j +1 


nA — 1 — 7 n 

< — ---!og(^n X ) + S P logO*" 1 ) \Y sP j 

3=1 

ST-1 i XP 1-X—1/ 


n 


< S n log 5 ~ 1 + <5 P log 5~ l O P {\) = o P ( 1). 

Thus, the matrices X -1 satisfy Condition C s i mp i e . We finally check Conditions 
(Cl) and (C2) with a / 0, Here we may write X -1 — al = — a(X — a _1 I)X _1 , 
and apply Lemma 5.9 with F = X — a -1 1 and G = X -1 . □ 


Remark. It follows from the preceding proof that if some matrices G n satisfy 
Condition C s i mp i e , then the inverse matrices G” 1 satisfy Conditions (Cl) and (C2) 
with a = 0. 


Lemma 5.11. Let F n = (X^) £1 ■ ■ ■ (X^) £| , where l G N, G N 

(not necessarily different) and £\ G {—1,+1} are fixed. Then F n satisfies 
Condition C simpie . 


Proof. By Lemma 5.10, the claim is true (even with the stronger Condition C) 
for l = 1. By Lemma 5.9 and induction, the claim remains true for l > 1. □ 


Lemma 5.12. For each n G N, let X n = (~L=Xjk)jk=i,...,n be a matrix as in (1.1), 
where the entries Xjare independent random variables satisfying (1.2) (1.4). 

Furthermore, for each n G N, let A n , B n and C n be random matrices of dimension 
n x n such that A n , B n , G n and X n are independent. 

(a) If the matrices A n and B n satisfy Condition C s i mp i e and the matrices C n satisfy 
Condition (CO), then the matrices A n X n B„ + C„ satisfy Condition C. 

(b) If the matrices A n and B„ satisfy Condition C s i mp i e and the matrices C n satisfy 
Condition C or C n = 0 for all n G N, then the matrices A„X~ 1 B n + C n satisfy 
Condition C. 


Proof. To shorten notation, we omit the index n throughout this proof. First of all, 
let us note that if a sequence of random matrices G n (with G n of dimension n x n) 
satisfies Condition (CO), there exists some Lg > 0 such that 

lim P(||G n || > n La ) = 0 . (5.26) 

n—>oo 


In fact, if p > 0 is such that ^ s*!(G n ) is bounded in probability as n —> oo 

and e > 0 is arbitrary, it follows that 

n 

limsupP(si(G n ) > n^ 1+£ - )//p ) < limsupP(^ ^s p (G n ) > n £ ) = 0, 


so that the assertion holds for any Lq, > 1/p. 
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(a) Condition (CO) follows from Corollary |6.4[ Corollary |6.2[ Holder’s inequality, 
and the fact that the matrices A, B, C and X satisfy Condition (CO). To prove 
Conditions (Cl) and (C2), we use the factorization 

AXB + C - cd = A(X + A -1 (C - aI)B~ 1 )B . 

Then, similarly as in the proof of Lemma |5.9[ it remains to be checked that for 
each of the three factors M n on the right-hand side, we have, for some Q > 0, 


P(s n (M n ) < n = o( 1) and 


1 y 

n / j 
ni<n<ri2 


log Sj(M n ) = op(l). 


For A and B, this is true by assumption. For X + A X (C — aI)B 1 , this follows 
from Lemmas 6.7 and 6.8 More precisely, if the matrices A and B satisfy Con¬ 


dition (Cl) with a = 0 and Q > 0, and the matrices C satisfy ( 5.26 ) with Lc > 0, 
we have P(si(A~ 1 (C — aI)B _1 ) > n 2 ® +Lc ) -A 0 by Theorem 6.1 Thus, we may 


use Lemmas |6.7| and |6.8| conditionally on A,B,C, and on the set of probability 
1 + o(l) where si(A -1 (C — aI)B _1 ) < n 2 ® +Lc . 

(b) We consider only the case that the matrices C satisfy Condition C, leaving 
the simpler case C = 0 to the reader. Similarly as above, Condition (CO) follows 
from Corollary |6.4[ Corollary |6.2[ Holder’s inequality, and the fact that the matrices 
A, B, C and X -1 satisfy Condition (CO). To prove Conditions (Cl) and (C2), 
we use the factorization 

AX^B + C - al = AX' 1 (B(C - aI) _1 A + X)A _1 (C - al) . 


Again, similarly as in the proof of Lemma |5.9| , it remains to be checked that for 
each of the five factors M n on the right-hand side, we have, for some Q > 0, 


(sn(M n ) < n Q ) = o( 1) and £ 


y 

n / j 
ni<n<ri‘2 


log Sj(M n ) = op(l) 


But this is true (i) by assumption, (ii) by Lemma 5.10, (iii) by Lemmas 6.7 and 6.8 


(applied conditionally on A, B, C), (iv) by the remark below Lemma 5.10, (v) 
by assumption. □ 


5.7. Proof of Theorem 5.4 


of Theorem 5.4 


After these preparations, we may turn to the proof 
Given a sequence of random matrices (G n ) n£ ^, we write u(G n ) 
for the singular value distributions, /x(G n G* ) for the squared singular value distri¬ 
butions, 5u(G n ) for the symmetrized singular value distributions, and i^g, /,igg* 
and Su g for the corresponding weak limits in probability (if existent). 

Let us first consider the singular value distributions. We will first use induction 
on l to prove the claim for the case m = 1 and then use induction on m to prove 
the claim for the case m > 1. More precisely, we will show the following: 


The matrices F n (X) from (1.5) satisfy Conditions A and B, 
and for any t > 0, the singular value distributions 
of the matrices F n ^(X) converge weakly in probability 
to the probability measure vt on (0, oo) with symmetrization 
Su t = (Q- 1 ( 


(5.27) 


Indeed, by Condition A, we may then let t —> 0 to get the limiting singular value 
distribution of the matrices F„(X). 
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Products of independent random matrices 
Conditions A and B follow from Lemmas |5.5| and |5.8| 
from the results in Section 


M x n,t( x «,t)*) It- Thus, d5.27[) is true for l = 1 


2.1 


For F n (X) = X n and F n (X) = X 
respectively, 
that, for t > 0 and e E {—1, +1}, we have 


-i 
n i 

It follows 


Now let l > 1, suppose that (5.27) holds for any (l — l)-fold product G n , and 


let F n be an Lfold product. Then we have the representation F„(X) = X® G n (X), 
where £ = +1 ore = - 1 and X n and G n (X) are independent. The inductive hypo¬ 
thesis ensures that /i(G n (X)G* (X)) — > hgg*, a non-random probability measure 


on (0,oo). It therefore follows from Lemmas 5.5 and 5.8 that the matrices F n (X) 
satisfy Conditions A and B. Now, for any t > 0, the matrices Y^ t and G ni t(Y) 
are independent bi-unitary invariant matrices with 

it and »(G n ,t(Y)G* n>t (Y)) -A A*G(t)G(t)* , 


respectively. Therefore, by asymptotic freeness (see Proposition 2.2 (a)) 


At(F n ,t(Y)F* it (Y)) -A 7 t e Kl /x G (t)G(t)* 


Thus, by Theorem |5.2|(a), (5.27) holds for the matrices F n (X) as well. 


Hence, by induction on l, we come to the conclusion that (5.27) holds for any 
product of independent matrices (i.e. for the case m = 1). 


Sums of products of independent random matrices. We have just proved (5.27) 
for m = 1. Now let m > 1, suppose that (5.27) holds for any (m — l)-fold sum 


C n of products of independent random matrices, and let F n be an m-fold sum 
of products of independent random matrices. Then we have the representation 
F n (X) = G n (X) + C n (X), where G n (X) = X£B n (X) (possibly with B n (X) = I n ) 
and X n , B n (X) and C n (X) are independent. The result for the case m = 1 
and the inductive hypothesis ensure that ^(B n (X)) —> v b and z/(C n (X)) -A i/q, 
respectively, where and uc are non-random probability measures on (0,oo). 
It therefore follows from Lemmas 5.5 and 5.8 that the matrices F n (X) satisfy 
Conditions A and B. Moreover, for any t > 0, the matrices G n ^(Y) and C nj f(Y) 
are independent bi-unitary invariant matrices with 

<5i / (G ni t(Y)) -A Sv G (t) and Sv(C nt t(Y)) — > Sv c ^ 


respectively. Therefore, by asymptotic freeness (see Proposition 2.2(c)), 


5v(F nj t(Y)) —> Su C (t) S SnG(t) 


Thus, by Theorem 5.2 (a), (5.27) holds for the matrices F n (X) as well. 


Hence, by induction on m. we come to the conclusion that (5.27) holds for any 


sum of products of independent matrices (i.e. for the case m > 1). 

Let us now consider the eigenvalue distributions. To begin with, using Lemma 
5.12, we may check by induction on m that the matrices F n (X) also satisfy 
Condition C. Therefore, as the matrices F„(X) satisfy Conditions A, B and C, 


we may use Theorem 5.2 (b), and it remains to determine the limiting eigenvalue 
distributions in the Gaussian case, i.e. for the matrices F n (Y). Here, it follows 
by asymptotic freeness (see Proposition |2.2| (d)) that Sv(F n f(Y) — al n ) -A Svt.a 
:= (Svt) EE3 B(a). Letting t -A 0 and using Condition A, it further follows that 
5^(F n (Y) — otl n ) -A Su a := (,Su ) ffl B(a), where u is the probability measure 
described in the theorem. Now use Theorem l2Tl □ 
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5.8. Rigorous Proof of Theorems 1.3 and |1.4[ 

Rigorous Proof of Theorem 1.3. By Theorem |5.4| the limiting eigenvalue distri- 


(oj 


and m (*+i)/ 2 (Fn + • • • + F„ ) in Theorem 


1.3 


are 


tuitions of the matrices F 
given by 

^(Q- 1 ( 7 r 1 K 7 f)) and w(p m _ (I+1)/2 (Q- 1 ( 7l - 1 KI 7 f J )) ffln ' 
respectively. Now, similarly as in the formal proof of Theorem |1.3[ we find that 

Q- 1 ( 7 l - 1 K 7 f) = a s {^) 

by comparing the S-transforms of the two measures, which concludes the proof. □ 


Rigorous Proof of Theorem l.f (Sketch). Here we need an analogue of Theorem 
|5.4| for certain products of powers of independent Girko-Ginibre matrices and 
their inverses. More precisely, we now consider random matrices of the form 

m m k 

F n := Y, 4 9) == E n^ X - 9 ' 1)Z+r) ) £r ) Zr ’ ( 5 ‘ 28 ) 

q= 1 q= 1 r= 1 

where m,k € N, £ 1 ,...,£& E {—1, +1} and ... , 4 E N are fixed, 

for some r = 1,.. ., k, we have l r = 1, (5.29) 

and the are independent Girko-Ginibre matrices as in the introduction. Then, 


similarly as in the proof of Theorem |5.4[ we need to verify Conditions A, B and C: 

Condition A. Here we can regularize the matrices (X" 1 )^ by means of ((X n ), _1 ) i 
(i.e. each factor in the power is regularized individually) and invoke Lemma |5.5| 
It is important here that in Lemma |5.5|, the matrices A n , B ra and C„ need not be 


independent of X„; see Remark 5.6 


Condition B. Here we may extend Lemma 5.8 to products of powers of independent 
Girko-Ginibre matrices, using similar arguments as in Sections 8.1.3 and 8.1.4 
in 


21 


Condition C. Under the extra condition (5.29), it follows from Lemma 5. 12| (applied 
with X = X( r )) and by induction on m that the matrices F n satisfy Condition C. 
(Unfortunately, without condition (5.29), Lemma 5.12 does not allow us to draw 
this conclusion in general, even though we would expect that Condition C continues 
to hold in this case.) 

After these considerations, it is straightforward to extend Theorem |5.4| to sums 


■ + FE) in Theorem 


1.4 


of products of powers satisfying (5.29). It follows that the limiting eigenv alue 
distributions of the matrices F^ and m _ ^ +1 ^ 2 (F^ + • 
are given by 

Kill 


• -^ 7 f'<■)) and w(P ro - CI+ i )/2 (Q- 1 ( 7 r 1 KI 7 f* 1 ia. • -K 7 f fc ) fflm )) 


respectively. Now, similarly as in the formal proof of Theorem |1.4[ we find that 

Q~\ If 1 B 7f 1 B • • • El 7 f fc ) = 

by comparing the S'-transforms of the two measures, which concludes the proof. □ 
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6. Appendix: Auxiliary Results 


6.1. Inequalities for Singular Values 

results from 


29 


In this section we collect a number of 
Section 3.3] which we use to verify Conditions (CO) - (C2). 
Throughout this section, we assume that A is a square matrix of dimension n X n 
with eigenvalues |Ai(A)| > • • • > |A n (A)| and singular values si(A) > • • • > s n (A). 
We usually state the results for the largest singular values, but using the relation 
Sj( A^ 1 ) = s~^- +1 (A), j = 1 ,...,n, it is immediate that similar results hold 
for the smallest singular values. Also, it is easy to see that Theorem 6.1 and 
its corollary extend to matrix products with more than two factors. 


Theorem 6.1 (Horn). For all k = 1 7 /(AB) < f][J =1 Sj(A)sj(B) , 

with equality for k = n. 


Corollary 6.2. For all p > 0 and all k = l,...,n, we have Ej=i( s j(AB)) p — 

EbfclAhIB})'. 


For the next lemma, let us make the convention that Sj( A) := 0 for j > n. 


Lemma 6.3. For all j, k = 1, ..., n, we have Sj + k~ i(A + B) < Sj( A) + Sfc(B) and 
Sj+k— i(-^ * • 5^(B). 

Corollary 6.4. For allp > 0, £"=, s p (A+B) < C p (E? = i s P ( A) + E”=i ^(B)) , 
where C p is a positive constant depending only on p. 


6.2. Bounds on Small Singular Values. In this section we cite some 
stochastic bounds for small singular values from the literature. We always assume 
that the matrices X n are Girko-Giuibre matrices as in (1.1) - (1.4). 


Lemma 6.5 ([22, Theorem 4.1]). Suppose that conditions (1.1) - (1.4) hold. Then, 
for any fixed «eC, there exist positive constants A and B such that 


Pr{s n (X n - al n ) < n A } < n 


-B 


Lemma 6.6 ([23, Lemma 5.2]). Suppose that conditions (1.1) - (1.4) hold. Then, 
for any fixed a G C, there exists a constant 0 < 7 < 1 such that for any sequence 

d n 0 , 

lim — \ | log s,(X n — al n )| = 0 almost surely, 

n^o o n z ' 

m<j <712 

with m = [n — n5 n ] + 1 and ri 2 = [n — n 7 ]. 

More generally, these results hold with o4 n replaced by M„, where (M n ) ne ^ is 
a sequence of deterministic matrices which is polynomially bounded in operator 
norm; see Section 5 in 23 for details: 


Lemma 6.7. Suppose that conditions (1.1) (1.4) hold. Then, for any fixed K > 0 

and L > 0, there exist positive constants A and B such that for any non-random 
matrix M n with ||M n ||2 < I\n L , we have 

Pr{s n (X n - M„) < n~ A } < n~ B . 













SUMS OF PRODUCTS OF NON-HERMITIAN RANDOM MATRICES 


31 


Lemma 6 . 8 . Suppose that conditions (1.1) - (1.4) hold. Then, for any fixed 
K > 0 and L > 0, there exists a constant 0 < 7 < 1 such that for any non-random 
matrices M n with ||M n ||2 < Kn L and for any sequence 5 n —> 0. 

1 X! log- s,(X„ - M„) = 0 almost surely , 
ni<j<n 2 

with n\ = [n — n5 n ] + 1 and 712 = [n — n 7 ]. 


lim 

n —¥00 77 , 
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